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ABSTRACT 

Docunents in this annotated bibliography provide 
specific instruients and procedures for evaluation of educational 
programs. Several bibliographies and documents on theoretical 
concerns of program evaluation are also included, but the orientation 
of the abstracts as a vhole ie toward the practical, rather than the 
theoretical. The listing is complete for all issues of . BIE through 
September 1973 and includes documents processed by this and other 
clearinghpuses. Based on the document resumes in RIB, the folloving 
information is presented for each document: personal or Institutional 
author, title, place of publication, publisher, publication date, 
number of pages, ERIC document (ED) number, price of the document if 
it is available from the ERIC Document Reproduction Service, and the 
abstract. Documents are listed alphabetically by author and are 
numbered. (Author) 
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PREFACE 



The Educational Hesources Information Center (ERIC) is a national informatiod 
system operated by the National Institute of Education. ERIC serves the 
educational community by disseminating educational research results and other 
resource information that can be used In developing more effective educational 
programs. 

The ERIC Clearinghouse on Educational Management, one of several 
clearinghouses In the system, was established at the University of Oregon in 
1966. The Clearinghouse and its companion units process research reports 
and journal articles for announcement in ERICAS index and abstract bulletins. 

Research reports are announced in Research in Education (RIE) ^ available 
in many libraries and by subscription for $21 a year from the United States 
Government Printing Office, Washington, D.C. 20402. Most of the documents 
listed in RIE c aivbe purchased through the ERIC Document Reproduction Ser- 
vice, operated by Leasee Information Products, Inc. 

Journal articles are announced in Current Index to Journals in Education . 
CUE t s also available in many libraries and can be ordered for $39 a year from 
CCM Information Corporation, 866 Thix*d Avenue, Room 1126, New York, New 
York 10022. Annual and semiannual cumulations can be ordered separately. 

Besides processing documents and journal articles, the Clearinghouse has 
another major function-- Information analysis and synthesis. The Clearinghouse 
prepares bibli(^raphies, literature reviews, state -of -the-knowledge papers, 
and other interpretive research studies on topics in its educational area. 

The ERIC Abstracts series is the result of a cooperative arrangement 
between the Clearinghouse and the National Academy for School Executives 
(NASE) of the American Association of School Administrators. The Clearing** 
house compiles the abstracts from document resumes in Research in Education 
to provide participants in a series of NASE-sponsored seminars with an up-to- 
date collection of ERIC m^^rials on subjects to be presented in these seminars. 
Additional copies of the abstracts are published by NASE and distributed across 
the country to school administrators and others interested in educational 
administration. 

Philip K. Piele 

Director, ERIC Clearinghouse 
on Educational Management 



The material in this publication was prepared pursuant to a contract with the 
National Institute of Educaticm/ U* S. Department of Health/ Education, and 
Welfare. Contractors undertaking such projects under government sponsor- 
ship are encouraged to express freely their Judgment in professional and tech-- 
nical matters. Prioj^' to publication, the manuscript was submitted to the 
American Association of School Administrators for critical review and deter- 
mination of professional competence. This publication has met such standards* 
Points of view or opinions, however, do not necessarily represent the official 
view or opinions of either the American Association of School Administrators 
or the Nationallnstitute of Education. 
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INTRODUCTION 



Since the beginning of ERIC In 1966, more than sixty thousand documents have 
been announced In ERIC's monthly catalog, Research In Education (RIE) / Of the 
total, more than five thousand documents have been processed by this Clearinghouse* 
This growing collection is so extensive that It Is useful to compile lists of ERIC 
documents on a number of critical topics In educational management • Published 
separately, these lists of documents make up the ERIC Abstracts series* 

To compile each list, the RIE subject Indexes are searched, using key terms 
that define the topic. The documents are selected on the basis of their currency, 
significance, and relevance to the topic. 

For this compilation on program evaluation, the Index term used Is 
PROGRAM EVALUATION* The documents provide, for the most part, specific 
procedures and instruments for evaluation of educational programs. Three 
annotated bibliographies and nine documents on the theory of program evaluation 
are also Included (for a more theory-oriented approach to progx^am evaluation, see 
ERIC Management Review Number 21, Program Evaluation > available free from 
the ERIC Clearinghouse on Educational Management, University of Oregon, 
Eugene, Oregon 97403)* The listing is complete for all issues of RIE through 
September 1973 and Includes documents processed by this and other clearinghouses* 

Based on the document resumes In RIE , the following information Is pre- 
sented for each document: personal or Institutional author, title, place of publi- 
cation, publisher, publication date, number of pages, ERIC document ('*FD") 
number, price of the document if It Is available from the ERIC Document 
Reproduction Service, and the abstract. The documents are listed alphabetically 
by author and are numbered. 

A subject Index, beginning on page 20, refers to the document listing 
number. The subject terms, arranged In alphabetical order, are Identical to 
those contained In the subject Index of RIE . 



HOW TO ORDER ERIC DOCUMENTS 



Most of the documents listed on the following pages can be ordered from the 
ERIC Document Reproduction Service, If a document Is available from EDRS» 
its prices for both hard copy apd microfiche are cited after the document's 
'^ED'' number, To order docxmients from EDRS/ Indicate: 

m the ED numbers of the desired documents (titles need 
not be furnished) 

# the type of reproduction desired— hard copy (HC) or 
microfiche (MF) 

• the number of copies being ordered 

Payment must accompany orders under $10, 00. Postage, at book rate 
or library rate, Is included In the price of the document. If flrst--class mailing 
Is desired or If shipment Is outside the continental United States, the difference 
between book rate or library rate and first-class or foreign postage will be 
billed at cost. All orders must be in writing. 

Address requests ioi 
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1 . Aebischer^ Delmer W. SeU^-Evaluattdn Checklist for School Music Pro> 

gramst (Grades 1-6 and Admlntatrator^s Form, ) Saleml Oregon State 
Board of Education, 1971. 27 pages, ED 069 682 MF $0.65 HC $3,29. 

Three checklists for evaluating elementary school music programs are 
designed for music teachers and administrators at the primary and In^ 
termedlate levels/ The Instruments Identify weaknesses and strengths 
of the school prbgram— for teachers In the areas of rl^thm, melody, 
harmony, form, expressive elements, creativity, listening, classroom 
performance, and overall evaluation, and for administrators In the areas 
of scheduling, materials, equipment, facilities, and overall evaluation, 
Items are rated poor, fair, good, or excellent. The bheckllsts were 
developed through university research, In-dlstrlct test use, and sub- 
sequent review by a committee of music educators and administrators, 

2. American Association of School Administrators. ERIC Abstracts; A 

Collection of ERIC Document Resumes on Assessing Educational Inno- 
vations. ERIC Abstracts Series, Number Twenty-three* Washington, 
D.C.: National Academy for School Executives, 1972. 21 pages. ED 
070 177 MF $0.65 HC $3.29. (Also available from National Academy 
for School Executives, 1801 North Moore Street, Arlington, Virginia 
22209. $2.00, quantity discount.) 

The documents Included In this annotated bibliography concern the change 
process, the choice and use of good Ideas, and the development of assess- 
ment and evaluation procedures for determining the achievement of 
objectives. The foUoN^ng Information Is presented for each document: 
author, title, place of publication, publisher, publication date, number 
of pages, ERIC document (ED) number, price, availability, and the 
abstract. A subject Index Is appended. 

3. Andersen, Dale O. , and others. Guidance Evaluation Guidelines. Guide- 

lines for Evaluation of Counseling and Guidance Programs. Olympla: 
Washington State Board of Education, 1967. 37 pages. ED 049 480 
MF $0.65 HC $3.29. 

Particular aspects of ovaluatlng coiuisellng and guidance programs are 
discussed, as are various services that must be Included If such programs 
are to serve the total educational program optimally. A short discussion 
of the Importance of evaluation, Its guiding j^llosophy, evaluation of 
staff qualities, and evaluation techniques Is followed by delineation of 
the dimensions of an evaluation study. These dimensions Include organU 
zatlonal and administrative structure, physical facilities, guidance 
personnel, and guidance services. The authors briefly consider avail- 
able federal, state, and local resources. A select bibliography concludes 
the publication. 
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4. Borg, Walter R. Three Levelg of Evaluation for Educational Products. 

1971. 10 pages. ED 054 229 MF $0.65 HC $3*29. 

Three levels of evaluation can be used to assass educational products 
and processes* The three levels—unvalidated form of experlencei 
validated form of experience, and direct performance evaluation—are 
each described In detail. The author also discusses the factors Involved 
In selection of the evaluation model* . 

5. Carpenter, C. , and Froke, Marlowe, Description of a Practical Pro- 

cedure for Assessing Instructional Film and Television Programs. 
University Park: Department of Psychology, Pennsylvania State Uni- 
versity, 1968. 43 pages. ED 037 102 MF $0.65 HC $3.29. 

A panel was formed to evaluate attributes of Instructional film and 
Instructional television programs that affect learning behavior. The 
panel found the exercise rewarding enough to recommend that addltlcHial 
panels of target audiences, educational specialists, content specialists, 
production specialists, and media specialists be set up as a system of 
evaluation for instructional tftlevlsion and film programs. The meetings 
are fully documented. 

6. Cook, Desmond L» Program Evaluation and Review Technique"Applicati<Mi8 

in Education ^ Washington, D*C. : Office of Education, Department of 
Health, Education, and Welfare, 1966. 109 pages. ED 016 533 MP 
$0.65 HC not available from EDRS. 



This monograph discusses the basic concepts and principles of a project 
management information system entitled program evaluation and review 
technique (PERT). PERT is a methodology for planning diverse activities 
in either large or small projects. Steps in the PERT technique Include 
work breakdown structure, network development, activity time estimation, 
network time calculation, scheduling^ probability aspects of PERT, re- 
plannlng the project, and PERT-cost. Several models illustrate areas 
in which PERT can be applied to educati<»ial research and development 
projects. These areas are experimental research, survey research, 
historical research, developmental projects, curriculum development, 
educational service projects, research integration projects, and theory 
development projects. The author also details practical considerations 
for implementing PERT in educational research and development projects. 

7. Educational Innovators Press. Performance and Process Objectives. Book* 
let for Developing Evaluative Skills Number 7. Tucson, Arizona; 1970. 
30 pages. ED 054 606 Document not available from EDRS. (Available 
from Educational Innovators Press, P. O. Box 13052, Tucson, Arizona 
85711* $2.25.) 
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A brief Introductory booklet defines perfom&n^ and process objectives 
and the contributions of each to the steps necessary for Incorporating 
f ccountablltty tn the evaluation of a given educatlcmal programi The 
text provides a set of procedures for developing and writing both per- 
formance and process objectives • The validity of process objectives 
can be determined only when they can be related to performance ob- 
jectives. This necessitates the development and writing of performance 
objectives at all levels of the educational structure for which process 
objectives are to be written, 

&• Eldell, Terry L,, and Klebe, John A., compilers. Annotated Blbllograply 
^ on the Evaluation of Educational Programs* Eugene: ERIC Clearinghouse 

on Educational Administration, University of Oregon, 1968# 19 pages* 
ED 025 857 MF $0,65 HC $3,29, 

Sixty-four books, pam0ilets, papers, and Journal articles published 
through 1968 are listed in this annotated bibliography on educational 
program evaluation on the elementarj', secondary, and higher education 
levels. Topics covered Include evaluation of school subject prc^rams, 
vocational programs, state aid programs, curriculum, educational 
planning, federal programs, teaching quality, educational change, and ^ > 
educational outcomes and quality. Some entries pertain to the development 
and use of mathematical models and cost-benefit analysis for evaluative 
purposes. Emphasis is on the methods, procedures, models, and ex- 
emplars of educational program evaluation. 

9. EPIC Evaluation Center, A Structure and Scheme for the Evaluation of 
Innovative Programs, The EPIC Brief, Issue No, 2, n.d. 19 pages. 
ED 028 103 MF$0.65 HC $3,29, 

Objective evaluation of school programs Is a process in which a school 
staff collects Information to ascertain whether a given set of objectives 
has been met. The Evaluative Programs for Innovative Currlculums 
(EPIC) four-step scheme of objective evaluation Is based on a three- 
dimensional structure of variables Influencing instructional prc^rams. 
The Instructional dimension Includes organization, content, method, 
facilities, and cost. The Institutional dimension refers to students, 
teachers, administrators, educational specialists, the family, and the 
community. The behavioral dimension ctmcems the psychomotor, 
affective, and cognitive domains. Planned program, the first step in 
the EPIC scheme, involves identifying the variables affectli^ the in- 
structional program under c<»i8lderation, combining variables Into 
factors, writing behavioral (performance) objective's, and developing 
the evaluative design. The second step Is program description and 
data gathering. Next Is data analysis. The decision-making recycling 
process is the final step. The text illustrates the EPIC scheme by 
applying It to a specific program. 

- 3 - 
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10. Fisher, Maurice D. , and Ward, Vli^ll S» ^'A Design for Evaluating 

Educational Programs for Culturally Disadvantaged Children;" Paper 
presented at American Educational Research Association annual meet- 
ing, Chicago, April 1972. 17 pages. ED 061 281 MF $0.65 HC $3.29. 

The evaluation design described In this paper covers all significant 
aspects of program development and follow-through for culturally 
disadvantaged children. Educational objectives, Instructional methods, 
Implementation procedures, and outcomes are also reviewed. 

11. Fleming, Margaret. '^An Approach to Evaluation of a Reading Program 

in the Public School Setting. Paper presented at American Educational 
Research Association conference, Minneapolis, March 1970. 12 pages. 
ED 040 012 MF$0.65 HC $3.29. 

The evaluation plan for the Reading Improvement Project in Cleveland's 
elementary schools Is described In this document. The plan's formation 
was Influenced by t^vo guidelines: the necessity of providing procedures 
to overcome threats to the validity of the findings, thereby facilitating 
sound assessment of program effects, and a desire to remain sensitive 
and responsive to realities of the school worlds Involved, particularly 
the concerns of pupils and staff participating In the project. Three 
critical Issues were encoimtered: random assignment of pupils to 
project services, choice of a model of analysis appropriate to the 
program's data collection procedures, and determination of whether 
experimental and control pupils received significantly different final 
reading marks. The author lists covarlates and dependent variables 
used as factors In the evaluation. 

12. iFresno County Department of Education.) Auvil, Mary S. PEAPOL 

(Program Evaluation at the Performance Objective Level) Outside 
Evaluation^ Fresno, California: 1972. 9 pages. ED 072 219 MF 
$0.65 HC $3.29. 

The PEAPOL (Program Evaluation at the Performance Objective Level) 
program developed a comjxiter system for assessing student progress 
and cost-effectiveness relative to the achievement of performance 
objectives. Interviews were conducted with project participants, in- 
cluding project staff, school administrators, and auto shop Instructors. 
Project documents were reviewed and a brief questionnaire used to ob- 
tain student opinions of this man--machlne system. The system will 
serve as a valuable change agent If computer data is used to generate 
reports for action by appropriate personnel. The reports are useful 
for pinpointing individual and class differences. Siiggestlons for 
future applications follow summary statements about the program's 
success In achieving Its objectives. Documents 12, 13, and 14 are 
related. 

. 4 - 
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13, Fresno County Department of Education! PEAPOLl (Program Evaluation 
at the Performance Objective LeveU User^g Manual. Fresno, Callforntaj 
1972. 77 pages. ED 072 220 MF $0.65 HC $3.29. 



The purpose of this manual is to provide a nontechnical description of 
the Fresno County system of program evaluation. Intended for the 
school administrator! teacher^ or researcher whose knowledge of 
electrcmlc data processing Is limited, the manual presents methods of 
using the system, procedures to support system operations, and Inter* 
pretatlons that should be given to reports generated by PEAPOL. The 
system is designed to allow vocational teachers and district administra- 
tors to monitor student progress and costs Incurred In Individual class- 
rooms. PEAPOL generates reports by Unking progress data to cost 
datOt the^^rfomance^ 6^^ level of instMctloh; Topics discussed 
In this document Inchide PEA POUs capabilities and limitations, a 
rationale, PEAPOL's use In vocational education, collecting and develop- 
ing class data, developing budget Information, changing records, and 
interpreting program output. Documents 12, 13, and 14 are related. 

14t Fresno County Department of Education. PEAPOL I (Program Evaluation 
at the Performance Objective Level) Technical Manual . Fresno, 
California! 1972. 100 pages. ED 072 221 MF $0.65 HC $3.29. 

Intended for people familiar with data processing, this technical manual 
describes the internal operations of the PEAPOL (Program Evaluation 
at the Performance Objective Level) system and Includes ten specific 
computer program descrlj^lonsjivlth floir charts. The system gmerate^ 
^ a series of reports by Unking progres^data to cost data at the perform- 
ance objecilve level of Instruction €tnd Is designed to allow vocational 
teachers and district administrators to monitor student progress and 
costs Incurred Jn Individual classrooms. The text reviews operational 
procedures, noting several requirements for utilizing PEAPOL: per- 
formance objectives with time allotments must be established, Individ- 
ualized Instruction Is necessary, a time clock to record Individual prog- 
ress Is required, and the school district must have access to a computer 
system programmed for PEAPOL. Documents 12, 13, and 14 are related. 

15. Glassner, Leonard E. Handbook for Evaluators. Pennsylvania: Office of 
Research, Pittsburgh Public Schools, 1969. 62 pages. ED 035 980 
MF $0.65 HC $3.29. 

This handbook provides an orientation to the Discrepancy Evaluation 
Model and a detailed outline of the administrative procedures necessary 
to conduct day-to-day activities In the first two stages of program evalua- 
tion. Guidelines for the first stage stress the need for coordination be- 
tween the evaluator and the program staff while planning, generating, 



and amending the program evaluation design. Second stage guide- 
lines speolfy requirements for implementing the evaluation design de« 
veloped in the first stage. The appendix includes summaries of 
completed evaluations of the Wttsburgh kindergarten program. 

16* Gold, Ben K. ^'Evaluation of Programs* ^» Paper presented at conference 
sponsored by Compensatoiy Education Project, Coordinating Board, 
Texas Collie and University System, Austin^ Apr lM971i 20 pages • 
ED 048 845 MF $OSB HC $3.29* 

Evaluation should be a process for collecting Information to make 
better decisions. The author discusses In detail four planning stages 
In program evaluation. The first stage requires the evaluator to as- 
certain the decision Vfeas 

tor must select the appropriate Information-gathering instruments. The 
third stage Involves data collection and analysis prior to the decision- 
maker's deadline* In the final stage, the evaluator repforts the findings 
to the decision-maker In time for use and in a readily understood form. 
The author offers eight references on the subject of evaluation. 

17. Harman, Harry H» , and others. Evaluation of Driver Education and 
Training Prot^rams » Princeton, New Jersey t Educational Testing 
Service, 1969. 70 pages. ED 041 106 Docutoent not avall^^ 
ED5S. (Available from National Technical Information Service, 
Springfield, Virginia 22161. PB 183 805 MP $0.95 HC$6.00.) 

An answer to the question, ''What c(mtrlbutl<»is do driver educatl<m and 
training programs make to the nation's highway safety program?*' was 
sought through a synthesis of four feaslblllly studies concerning the 
effectiveness of current or proposed driver education programs. The 
preliminary Investigations failed to Identify any clear proof that driver 
education, as presently constituted, has a significantly favorable effect 
on driver performance, particularly as measured by accidents and 
traffic taw violations. Therefore, a comprehensive tttddel for evaluating 
driver education programs was developed, Inoludlng both short-term 
and long-term activities. Short-term activities Include driving task 
analysis, objectives of driver education, evaluation of prc^ ram content, 
and specifications for long-term evaluation. Long-term activities are 
measures of driver performance, measures of program characteristics, 
measures of highway traffic system objectives, and research studies 
using proximate and ultimate criteria. 



18. Hartwlg, Keith E. A Basic Model for Planning, Monitoring, and Evaluating 
Educational Programs . 1971. 4 pages. ED 053 196 MF $0.65 
HC $3t29« 



Thts paper presents a brief description of a basic model for planning^ 
monitoring^ and evaluating educational programs using managerial 
concepts* The model Involves five steps: Identification of a need; 
statement of desired outcomes (objectives); development of a programi 
Including processes and resources} ongoing evaluation (monitoring) j 
and terminal evaluation. The approach is straightforward and easily 
tmderstood by anyone lacking sophistication In a management approach 
to education. The model Is In the developmental stage and Is by no 
means complete. The system has been found useful In presenting a 
management approach to education to teachers and school administra- 
tors. 

19. Jacobs, Paul "Criteria for Evaluating High School English ProgramsJ' 

English JournaU 57, 9 (December 1968), pp. 1275-1296. ED 029 024 
Document not available from EDRS. 

Designed to assist English teachers and departments In analyzing and 
evaluating current programs, this checklist Is divided Into four parts: 
bksic organization and procedures of the English program (25 criteria); 
physical provisions for English Instruction, both facilities and equip- 
ment (11 criteria) and materials (2 criteria); qualifications of English 
teachers (7 criteria); and English curriculum and Instruction (103 cri- 
teria). The curriculum checklist Is subdivided into three sections: 
the curriculum as a learning system, the curriculum as a^ole, and 
the various parts of the curriculum— literature, language, composition 
(both written and oral), reading, and speech. 

20. Jaeger, Rlchard M. ''Evaluation of National Educational Programs; The 

Goals and the Instruments.'* Paper presented at American Educational 
Research Association annual meeting, Minneapolis, March 1970* Wash- 
ington, D. C. J Bureau of Elementary and Secondary Education, Office 
of Education, Department of Health, Education, and Welfare. 20 pa/ics. 
ED 041 949 MF $0.65 HC $3.29. 

A Joint comprehensive evaluation system for the assessment of fifteen 
federal programs has been developed by the United States Office of Edu- 
cation. Diverse program services will be treated as resources available 
to meet the needs of critical target groups. Nine crucial questions in 
program management need to be answered* The evaluative design to 
find the answers to these questions proposes to use the Individual pupil 
as the unit of analysis. Using sample survey methods and multiple 
matrix sampling (different Individuals complete different samples of 
test Items), It will be possible to collect comparable and generallzable 
data without putting an undue testing burden on any one student. Data 
collection Instruments are discussed in some detail. 
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21. Jay, Charles D.i am castle, Pat. Guidelines for Evaluating Forettifn 
Lan^uan^e Progrg ns. Springfield ; Illinois State Of flee of the Super- 
intendent of Publio Instruction, n.d. 13 pages. ED Old 592 MF $0.65 

/'HC":$3*29« ■■ 

A need for simplified criteria by vhloh secondary schools can measure 
the excellence of their foreign language programs has stimulated the 
development of these guidelines. The guidelines are designed to assist 
In setting up the best possible audlollngually oriented curriculum to 
meet the Individual needs of schools* Following an outline of basic In- 
formation about sequence of study, texts and materials, and electronic 
equipment, the guide lists, In questionnaire form, criteria that Indicate 
superior foreign language programs* Highlighted In the questioning are 

^ * ^ the areas of general methodologyr elementary, Junior high, and b^ 

and advanced high school language programs; Latin programs; and test- 
ing and evaluation* 

22* Kidder, Mary Jane, compiler. Searchlight: Relevant Resources In High 
Interest Areas* Program Evaluation and Accountability* 7R Retro- 
spective Search * Ann Arbor> Mlchlganj ERIC Clearinghouse on Counsel- 
ing and Personnel Services, 1971* 18 pages. ED 061 66$ MF $0*65 
HC $3*29* (Also available from ERIC/CAPS, Room 2180, School of 
Education Building, University of Michigan, Ann Arbor Michigan 
48104, $1*00.) 

A search of the ERIC system, Dissertation Abstracts, and Journal 
literature has yielded 28 documents abstracted Tri this compilation/ 
Documents review niethods of program evaluation and! the extent to 
which programs and counselors are effective In contributing to favor- 
able student development* 

23* Kllpatrlck, Jeremy. ^'Evaluating a Unified Mathematics Curriculum* 

Presented at American Educational Research Association symposium, 
Minneapolis, March 1970. 4 pages. ED 042 811 MF $0*66 HC $3*29* 

A method of evaluating the Secondary School Mathematics Curriculum 
Improvement Study (SSMCIS) Is discussed. The main task of SSMCIS 
Is production and tryout of textbook materials, Cdlthough teacher train- 
ing Is also an important component of the study* Informal teacher feed- 
back and sporadic testing provide the main thrust of the program evalua-^ 
tton* One study /lOtes the discrepancy between the views of teachers and 
students on some features of the text materials and suggests tHo 
to acquire more direct Information from the students concerning course 
materials* Most evaluation activities have concentrated on support 
functions rather than the project Itself* Hie cojlciuslon raise! the 
question of whether full-scale formative evaluation bfthe^s^^ would 
be aMf Btr^^^^^^^^ in influencing currlettluiii rcylslotfi^^^^^^^^^^ 



24. Klein, Stephen P. "Ongoing Evaluation of Educational Programs. " Paper 

presented at American Psychological Association convention, Honolulu, 
Hawaii, September 1972. 12 pages. ED 069 725 MF $0.66 HC $3.29. 

Three distinctions are usually made between norm-referenced and 
criterion- referenced measures. These distinctions are In the areas of 
measurement forms (student performance in relation to the performance 
of other students or with respect to some specific criterion), general 
or specific types of objectives In which the measures are founded, and 
modes of construction (reliance <m Items that differentiate among stu- 
dents or Items that reveal degree of mastery on a given objective), 
Examinations of how both types of measures are actually constructed 
and used, however, Indicate that these distinctions are misleading and 

can weaken the overall value.of the. evaluatlon.effort.._For.fivaluatLQli 

purposes, the essential difference between norm- referenced and 
criterion-referenced measures should not be viewed as an Intrinsic 
measurement difference but as a question of Interpretation of the meas- 
urement. Concerning ongoing evaluation, both norm-referenced and 
criterion-referenced Interpretations are needed for such diverse pur- 
poses as Identifying program components needing Improvement, Iden- 
tifying students heeding special attentltm, providing the basis for 
accountablllfy systems, and determining whether a program Is being 
Implemented as planned. Unless both types of Interpretatlwis are made, 
.realistic evaluations are Impossible, Both types of Interpretations are 
necessary for realistic evaluation. 

25. KUt, John A. , and Wentllng, Tim L. "The Development and Implementation 

of a Statewide Evaluation iSfystem. " Paper presented at American Edu- 
cational Research Association convention. New Orleans, February 1973. 
21 pages. ED 075 508 MF $0.66 HC $3.29. 

An Illinois evaluation system has been designed to evaluate continuously 
the total occupational programs of Illinois local education agencies, 
Consisting of three phases, the system Involves local planning, state 
review and evaluation of local planning documents, and onslte visitation 
of local education agencies by a team of Individuals from outside the 
agency. The structure of the system also allows ttie state education 
agency staff to monitor any changes In local programs. Several aspect^ 
of the system have greatly enhanced Its success? tii*e total occUpatlonaV 
programj the composition of the visiting teatrij the fact thal all team 
members have input to aspects of tii^ final report} suglfested ablutions 
to accomplish reconih\endatiori¥ by'the teamj' th61tj'at\iF678f the SUWlHary 
corii!?)yeMe}^|||[i^^^ Srrore In the repoirt before pi'tntlngj ; . 

and fi bitlt-ftf*o!l6wip of tfe fiysteni. 
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ltoti%ihe indivtdualty Prescribed Instwi6tl6ft Prdiect. Phll&ddlpht|r;|^g 



Research for Better Schools » Inc. , (1969]. 8 pages, £0 036 179 MF 
$0.65 HC $3,29t 

Evaluation of an educational Innovation can aid In development of the 
Innovation and provide a basis for making Judgments with respect to 
the Innovation* This report discusses the Individually Prescribed In- 
struction (IPI) program and Its approach to evaluation. IPI evaluation 
activities are carried out In six areas: program plan, operating pro- 
gram, school context, pupil behavior, teacher behavior, and unplanned 
influences and other variables* 

27* Maxey, James. {^Evaluation of the Outcomes of Modular Scheduling*^' 

Paper prepared for Iowa Center for Research In School Administration 
annual membership meeting. .^lowa Cltyi Jowa . Center for Research In . 
School Administration, University of Iowa, 1988. 10 pages* ED 026 
733 MF $0.65 HC $3.29. 

Four studies conducted on Junior and senior high schools that have used 
some form of modular scheduling suggest that a proper way to evaluate 
flexible scheduling Includes observation of behavior, measurement of 
attitudes and opinions, and assessment of pupil achievement* The text 
concludes that observable behavior can be evaluated by recording patterns 
of classroom activity; student, teacher, and parental views of flexible 
scheduling can be assessed via oplnlonnalresj the relative effectiveness 
of Independent study, large-group Instruction, and small-group activity 
can be evaluated through opinlonnalresj and teaching effectiveness can 
be determined through comparative achievement testing. 

28. McGuigan, F. J. How to Select and Evaluate Programmed Instructional 
Materials. Raleigh: School of Education, North Carolina State Uni- 
versity, 1971. 20 pages. ED 051 455 MF $0.65 HC $3.29. 

The large number of Instructional programs commercially available at 
all educational levels presents the teacher with a major selection prob- 
lem. This document explains the assessment procedures publishers 
should use to assure publication of only high quality programs. When he 
first receives a program, a publisher should have It checked by an ex- 
pert and make a decision as to whether the program Is academically 
^ sound and whether It Is appropriate for a specific educational curriculum. 
The program Is then objectively tested in a classroom situation. Once 
appropriate sample subjects are selected, the students are administered 
an objective achievement test as a pretest* Next, the students work 
through the program. Variables other than the program Itself are mini- 
mized. On completion of the program, the students take the achievement 
test again as a posttest* Finally^ students and teachers complete stand- 
ard pto^ram evaluation forms* Data gathered from the pretests and 
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posttests, from the students' actual work on the program, and from the 
evaluation forms are then analyzed. The publisher's final decision 
whether or not to publish the program Is made according to the criterion 
of the amount a student learns throygh use of the program. 

29. Merrlman, Howard O. Evaluation of Planned Educational Change at the 

Local Education Agency Level . Columbusi Evaluatlwi Center, Ohio 
State University, 1967. 16 pages. ED 025 042 MF $0.65 HC $3.29. 

Based on a systems analysis approach, a fouxvr^age evaluation model 
called CIPP (context. Input, process, product) assesses Innovative pro- 
grams In education. The model Is both a way of viewing planned educa- 
tional change and a decision-making tool for the administrator In the 
* " local education agency; Development of the model Includes a method for— - 
organizing relevant factors of the total Information flow, a procedure for 
Identifying program deficiencies, and an extensive outline of evaluative 
criteria. 

30. Mltzel, Harold E. How to Evaluate Computer Assisted Instruction . Uni- 

versity Park: Pennsrylvanla State University, 1970. 6 pages. ED 047 
005 MF $0.65 HC$3.29. 

i ■■ ■ 

Rather than presenting a cookbook recipe for evaluation of computer 

assisted Instruction (CAI), this document discusses a number of queries 
relevant to the evaluation of CAI. Is It possible that CAI offers oppor- 
tunities to reach cognitive Instructlaial objectives to which users of 
conventional methods do not a$plre? Is It reasonable to compare CAI 
and conventional methods performance In a single subject when tiie 
pupils under study are enrolled In four or five other subjects taught by 
conventional processes? In an overall evaluation of CAI, how does <me 
ensure the proper weighting of cognitive criteria based on pupil achieve- 
ment and affective criteria based on pupil attitudes and feelings? If we 
classify the dependent variables of CAI evaluation Into two catteries, 
obtrusive and unobtrusive, fire both equally persuasive to deolslon-makers? 
Some suggested unobtrusive measures are length of attention span, mas- 
tery time, and absentee rate. 

31. Nelson, Helen Y. , and Jacoby, Gertrude P. Evaluation of Secondary 

School Programs to Prepare Sitfdents'for Wflf^e Earning In Ocdtipatlons ; < 
Related to Homy EcoiilotHlos. Final R6t!R)H. ^^oU 11. A!»^fldl?t. Ithac&j 
New York State C6negrbf H6me Economics, 1967. 184'J)^e^. ED 
022 036' M^* $6.65 HC' $^'.18^^^^^ : 




food service workers and child care aides; tests of child care and food 
service employment preparation} student questionnaires of attitudes, 
interests, expectations, and self-concept; and an Interview schedule. 
The second section offers employer and student descriptive rating scales 
and communications to student and employer for followup studies. The 
third section Includes teacher record forms for work experience, fl'^ 
nanclng. Instructional materials, teacher attitudes toward the course, 
evaluation of the pilot program, preteachlng and teaching time demands^ 
child care facilities, and food service. The fourth section is an eighteen 
page bibliography of books, pamphlets, magazines, newspapers, and 
audiovisual materials classified for occupational home economics, 
child care, and food services. The fifth section consists of guidance 
forms to gather Information about personal and academic qualifications 
of students. The final section lists data analysis Information. - 

Nlvette, James D, A Rationale and Methodology for Designing Logical 
Evaluations for School Programs. Research Study Series. 1967-68. 
California! Los Angeles County Superintendent of Schools, 1969. 23 
pages. ED 036 830 MF $0.65 HC $3.29. 

This document discusses educational evaluation and design. Five steps 
are essential in evaluation: deflnltl<M\ of educational objectives In be- 
havioral terms, translation of the objective Into descriptions of behavior, 
identification of situations In which the designated behavior can be ob- 
served, establishment of an interpretive device that can measure the 
, desired growth, and statement of conclusions r^arding the extent to 
which the objectives were achieved. Two tables present alternative 
methods for simple evaluation procedure designs. The development of 
objectives Is also discussed, Objectives should describe what the stu- 
dent does, describe conditions under which his performance can be db- 
served, and define the standards the student miist meet. The evaluative 
process Itself Is considered. Five evaluative designs are reviewed, as 
is the use of ccmtrol groups and standardized tests. Evaluative criteria 
dealing with Interest might employ questionnaires, attendance records, 
case studies, and so forth. The author Includes a list of standardized 
tests, including personality, Interest, and achievement tests useful In 
evaluation. A statistical refresher cwtalns deflnlticms of measurement 
terms and a discussion of the nature and purposes of statistics In re- 
lation to evaluation designs. 

Randall, Robert S. "An Operational Application of the Stufflebeam-Guba 
CIPP Mod6l for Evaluation. " Paper presented at American Educational 
Research Association annual meeting, Los Angeles, February 1969. 
9 pages. ED 027 633 MP $0.65 HC $3.29. 

The Stvfflebeam-Cfuba CIPP (context. Input, process, product) m<>del 
fOK* 0f4Wiftl^n i>f Innovations In education attempts to maklmlze the" ; 



effectiveness of critical decisions through timely reporting of relevant 
information in a useful form to appropriate levels of decision-making; 
Evaluation is thus seen as the combination of effective decisions based 
on ttmelyi relevant informatIon» The system focuses on four classes 
of decisions and is designed to yield four kinds of information to serve 
those declsi(X) situations « The four classes of decisions are context 
evaluation, design evaluation, process evaluation, and product evalua- 
tion. ConteKt evaluation consists of planning decisions and the context 
information that serves those decisions and deals with the setting of 
priorities and the selection of strategies* Design evaluation entails 
structuring decisions that depend on design information* In this phase, 
objectives are specified and means to attain the objectives selected* 
Process evaluation ccmcems the possible need to restructure the pro- 
gram after results of pilot testing and previous evaluations are in r Prod- 
uct evaluation considers evidence of the programme effectiveness in 
attaining its overall goals/ Problems In applying this system might 
include identifying decisions and deciaion-makers, timing decisions, 
Identifying relevant information, and reporting information in a use- 
ful form* 

34 . Rapp, Marjorle L. "The Analytical Aspects of Evaluating On-Going- Pro- 
grams. '' Paper presented at American Educational Research Associa- 
tion annual meeting, Chicago, April 1972. 7 pages. ED 062 718 MF 
$0*65 HC $3.29* 

This paper presents a model for continuous, systematic evaluation of 
ongoing programs and specifies data needed for decision-making In the 
areas of program adoption, curtailment, or expansion^ These data give 
the decision-maker the necessary Information for prc^ram planning In 
today's sophisticated educational environment. 

35* Reynolds, Harris W. , and others. Evaluative Criteria for Vocational 

Technical Programs. Harrlsburg: Bureau of Curriculum Planning and 
Schdol E^alffatI6n, Pehnsylvanla State Department of Pi.ibllc rnstnictlon, 
1967. 135 pages. ED 022 861 MF $0.65 HC $6.58. 

Evaluation must be an Integral part of the educational process and must 
be cwicerned with the continuing development of better procedures and 
techniques for measuring <aiitcomes of the educational program. The 
best evaluation Is local school district self-evaluatloh^ This manual 
provides forms for self^evaluation of vocational-technical school pro- 
grams In the areas of administration, school plant (physical facilities), 
school library, student activities, guidance, agriculture^ buslniess edu- 
cation, dlstrlbutlv^e^^^^^ home econbmlcltH|e^^^ did ijfi^ifrlal 
e^dhiCfttlo|,"^^^ sh6p-laboratory» the erl&tla In eacb Srek are 
'llsildl^^^^ scale and a space for ekplanStory notes. 
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The self- evaluation process should be directed by a steering committee 
and involve the entire staff of the vocational-techntcal school. Each 
staff member should serve on a subcommittee in addition to completing 
a self- evaluation form in his own area» The steering committee should 
be responsible for developing a final report from subcommittee re- 
ports. As a result of the evaluation! Inservice programs should be 
Instituted to bring about the Improvements Indicated* Procedures for 
evaluations conducted by the Pennsylvania Department of Public In- 
struction, Division of Evaluation, are included. 

36* Rippey, Robertv ^Introductionr What Is Transacticmal Evaluation?" 

Paper presented at American Educational Research Association annual 
meeting, Chicago, April 1972» 6 pages. ED 060 071 MF $0.65 

~ ' "'HG $3i29< 

This paper discusses the characteristics and operation of an evalua- 
tion process— transactional evaluatlwi. Concentrating on the effects 
change has on those effecting the change, transactional evaluation 
itresses incorporation of both protagonists and antagonists of change 
into a change-oriented team. A copy of an evaluation questionnaire 
Is Included. 

37. Sorenson, Garth. "A New Role In Education? The Evaluator. '' Evalua - 
tion Comments 1, 1 (January 1968). Los Angeles: Center for the 
Study of Evaluation of Instructional Programs, University of California. 
4 pages. ED 021 818 MF $0.65 HC $3.29. 

With the increase of federal funds for education, a new profession is 
emerging— the evaluator. His role needs to be more clearly defined. 
First of all, he must not take an absolutist position In his relationship 
to other educational experts or he will fall to get the cooperation of 
- " teachers and the support of powerful community groups. Second, he 
must accept certain basic assumptions with regard to educational 
goals: educational goals should be defined In a process of Interaction 
between professionals and representatives of the society, goals and 
practices must be varied to accommodate a diverse population and 
must change as needs and values change, and goals must not be limited 
to purely academic objectives and must be stated In descriptive rather 
than Interpretive language. The professional evaluator should help 
teachers and administrators In a given school define their goals In 
terms of pupil performance, learn how to discover systematically 
differences among pupils that require particular kinds of Instruct tern, 
and design and administer evaluatloh programs to find out which In- 
st ruetlonfi||irocedufe8 are worthwhile* The research and development 
evaluat6i*1vill perhaps bridge the gap between the laboratory and the 
field by making explicit to the Iridfvfdual teacher the relevance of re- 
search flhdlrigjS id the teacher^s worki 



38. Stdk6, Robert '♦Toward a Technology for the Evaluation of iEducatlonal 

Programs*^' In Perepectlvei^ of Curriculum Evaluatloni American Edu- 
cational Research Association Myograph Series on Curriculum Evalua- 
tion, edited by Ralph W. Tyler and others. Chicago: Rand McNally 
and Company, 1967. 17 pages. ED 030 948 MP $0. 65 HC$3. 29. 
{Also available from Rand McNally and Company, P. 0. Box 7600, 
Chicago, Illinois 60680. Complete document, 102 pages, $3.60.) 

Reflecting an Increased awareness of the need for comprehensive cur-^ 
rlculum evaluation, this monograph focuses on major aspects of curricu- 
lum design and development. Curriculum evaluation Is the collection, 
processing, and Interpretation of two main kinds of data: objective 
descriptions of a curriculum's goals, environments, personnel, methods, 
content, and outcomes; and personal judgments by. the evaluator of the 
currlculum*s goals, envlrcaiments, persctfinel, methods, content, and 
outcomes. Available tests related to the evaluation of Instruction sel- 
dom go beyond achievement testing. New techniques of observation 
and judgment are needed, with greater attention given diagnostic test- 
ing, task analyses, and evaluation of goals. As reported In the grow- 
ing literature on measurement and evaluation, special techniques 
employed In the behavioral sciences should be utilized In curriculum 
evaluation. 

39. Stake, Robert E. 7 'An Approach to the Evaluatlcm of Instructional Pro- 

grams.*^ Paper presented at American Educational Research Assocla^ 
tlon annual meeting, Chicago, April 1972. 8 pages. ED 0(34 350 
MF $0.65 HC $3.29. 

This paper discusses evaluation of an educational program through 
portrayal of the program rather than the focus of the program. The 
author suggests that the program ev^luator llmlt'hls evaluation alms 
to what he can do and what the client needs most. The first duty of 
the evaluator should be to offer the client a comprehensive portrayal 
of the program. 

40. Stake, Robert E. Responsive Evaluatl<m, 1972. 4 pages. ED 075 487 

MF$0.65 HC$3.29. e 

The definition, structures, utilities, stimilus-responge differences, 
and portrayals of responsive evaluation are presented- An educational 
evaluatlon ls said to be responsive if U orients moye directly to pro- 
gram activities than to program intents, If It responds to audience re- 
quirements for Ihformatlon, and if the different value perspeoilves 
liresefit iiiffe referred to Ih re^rtln^ t|ae ^Uccffs |H(^^ 
sB^^^^ Ip'ffei^iiorislvc Iv'aluatlon follows ttis'priwifity^^ . 
of WlttitM^ i.The chbicd of tests m other dataT^gathef lnfe 



devices Is based on observation of the program In actlcHi and Inter- 
actlon^wlth various Interested groups. Responsive evaluatlm Is par^ 
tlcularly useful during both formative and summatlve evaluation. 
The principal stimuli of responsive evaluation are those of the pro* 
gram, Including responses of students and subsequent dialogue* The 
responsive approach responds to the naturaVways In which people 
assimilate Information and arrive at understandlt^* Program portrayal 
may feature descriptions of persons, often by case studies. The 
challenge to the evaluator Is to minimize the sampling error and find 
ways to authenticate this less scientific method of reporting. 

41. Tanner, C. Kenneth. ^^Program Evaluation In Cost Benefit Terms.'* 

Paper presented at American Educational Research Association 
annual meeting, Minneapolis^ March 1970^ 15 pages. ED 042 228 
MF$0.65 HC$3.29. 

This paper advances a model, called the expected opportunity loss 
model, for curriculum evaluation. This decision- making technique 
utilizes subjective data by ranking courses according to their ex- 
pected contributions to the primary objective of the total progvam. 
The model also utilizes objective data In the form of component costs 
and differs from traditional cost-effectiveness models In that It places 
lesB emphasis on the cost components* The decision model formulates 
alternatives for declslon-makli^ under uncertainty and appraises the 
probable or conditional opportunity loss. The minimum loss is the 
optimum decision. 

42. Unks, Nancy J. , and Cox, Richard C* "A Model for the Evaluation of a 

Testing Program. Working Paper Number Four of tb? Program of 
Studies In Educational Research. Paper presented at American 
Educational Research Association annual meeting^ Chicago, February 
1968. Philadelphia: Research for Better Schools, Inc. 7 pages. 
ED 036 190 MF $0.65 HC $3.29. 

Evaluation of a testing program Is necessary before or during a sound 
total project evaluation. Ideally, the testing program study should be 
concurrent with, and equal In magnitude to, the total project evaluation. 
The first step In an evaluation Is definition of testing program objectives 
In operational terms. The second step Is a thorough description of the 
Innovation to be studied. Then the evaluation program should examine 
the Instruments used to conduct tests, obtaining validity, reliability, 
and item analysis data for all such instruments* A summary Interprets 
information accumulated in the flrM three phases. This paper presents 
a diagram of such an evaluation procedure. 

43. Wagner, Andrew R. * What You AlWays Felt YoU Should Know about 

PERT^ bdt Were Afraid tc fin^ Odti JSxpaft^ln^ Evalu^l^h Cphdeptsj 



Applications and Reflections* " Paper presented at American Edu- 
cational Research Association annual meeting^ New OrteanSi February 
1973, 8 pages. ED 075 514 MP $0.65 HC $3.29^ 

PERT is an aorcmym for Project Evaluation and Review Technique* 
The first step In a PERT analysis Is the listing of every activity re- 
quired to accomplish the project. This is accomplished In three 
stages? listing major tasks, assigning dates to each of these tasks, 
and listing activities that must be performed to accomplish each task* 
Once a project begins, the manager should hold regular meetings with 
the task leaders to reanalyze the schedule. The implications of awy 
variances can be discussed In conjunction with supplementary PERT 
analyses. 

44. Welty, Gordc»i A^ The Logic of Evaluation . 1968. 29 pages. ED 028 

732 MF $0.65 HC $3.29. 

The logic of evaluation of educational and other action programs Is s 
discussed from a methodological viewpoint. No attempt Is made to 
develop methods of program evaluation. The first part of the docu- 
ment views the structure of an educational program as a system with 
three components: Inputs, transformation of inputs Into outputs, and 
outputs. The second part discusses the necessary condition for a pro- 
gram to be a system: the presence of feedback loops. The school 
system with an evaluation unit Is one example of a program with feed- 
back loops. In the third section, the possibility of mapping experimental 
designs Into social space characterized by feedback loops Is confirmed 
while Stufflebeam's statements to the contrary are refuted. The fourth 
section examines the historical precedents for the findings and con- 
cludes that It Is possible, from a methodological viewpoint, to Imple- 
ment a rigorous experimental design and to provide feedback for 
managerial decision-making In the context of action research. 

45. Wentllng, Tim L. , and Klit, John A. <<Meta-Evaluatlon Applied: The 

Evaluation of a Large Scale Evaluation i^stem.'* Paper presented at 
American Educational Research Association convention, New Orleans, 
February 1973. 22 pages. ED 076 609 MF $0.65 HC $3.29. 

This meta-e valuation sought to evaluate the personnel, pr6cedures, and 
impact of a statewide evaluation system. Personnel evaluation provided 
both formative and summatlve information as well as Information per- 
taining to future selection of evaluation personnel. Evaluation of pro- 
cedures led to mj^ny revisions and refinements In the procedures and 
Instrumentation of the evaluation system. The Impact study silpplied 
data'io ihdlc^ate that the evaluation system did have consldotabl^ impact 
in l>ringtfii^ about changes and improvements In local plans i Significant 




side effects Included the reorganization of state education organization 
c<Mi8uUant services. In addition to meeting the Informational needs 
for revision of the system In Illinois, the meta-evaluatlon has yielded 
data to Justify the retention of the three-phase system In future years. 

46. White, William F. "Information Feedback Systems (IFS) and Educa- 

tional Goals. " Paper presented at Session I of Southeastern Invita- 
tional Conference on Measurement In Education, Athens, Georgia, 
December 1972. 14 pages. ED 075 463 Document not available 
fromEDRS, (Available as part of Invitational Ccmferenoe on Measure- 
ment In Education; Proceedbgs foTthe) Eleventh Southeastern Con- 
ference (December 8-9. 1972K Session I. compiled by Thomas M. 
Goolsby, Jr. Papers presented at Session I of Southeastern Invita- 
tional Conference on Measurement In Education, Athens, Georgia, 
December 1972. Athens: College of Education, University of Georgia. 
211 pages. ED 076 449 MF $0.65 HC $9.87.) 

An Information feedback system for evaluating an educational program 
Is described, and Its effectiveness In evaluatli^ the Follow Through 
program and Its use In relation to the Iowa Tests of Basic Skills are 
discussed. The systems approach to program evaluttlon consists of 
objectives clarification, decision-making, and program planning, In 
the Follow Through project, several components are recommended for 
an Ideal Information system» ' administration, dissemination, instruc- 
tion, medloal-dental, nutritional, psychological services, social ser- 
vices, parental Involvement, and evaluation. Instruments are used In 
each component to gather data to register any progress toward com- 
ponent objectives, The text provides an example of Instructional feed- 
back In relation to leading MhLOTemeji(8^C0Bd.an'd_^^^^^ gr,ai$S)-8ad 
presents a feedback report for health services In tabular format. Feed- 
back sessions generally focus on three areas: achievement problems, 
testing skills, and general prpblem-solvlng skills. The Iowa Tests of 
Basic Skills Includes Vocabulary, Word Analysis, and Reading Compre- 
hension sections. A sample b! one class's Item analysis of vocabulary 
Is provided. The Behavioral Maturity Scale can provide feedback to 
the teacher and the teacher aide about their perceptions of the maturity 
of each child. 

47. Wyille, Eugene Donald. An Evaluation Plan for Business Education Pro- 

grams In High Schools. South-Westem Monographs In Business and 
Economic Education. Number 109, 1963. 40 pages, ED 016 851 
MF$0.6$ HC$3.29. 

This plafl was developed from a doctoral study with the cooperation of 
membei's 6t the Indiana Business Education Association, fE$'f>% was 
u$e4|or evaluation purposes Ih t\vfehty-»fiv6 high «choofrf# lufesl^^ntly 



revised. The evaluation Instrument consists of nine sections: curri- 
culum} Instructional content} Instructional activities, methods, and 
procedures} Instructional materials} guidance} extraclass activities} 
home, business, and community relations} physical facilities and 
equipment} and staff. Each section Is divided Into subsections. Each 
subsection Is Introduced by a criterion followed by a series of check- 
list Items that are specific statements of' optimum conditions, practices, 
and characteristics relating to the comprehensive general criterion. 
Each staff member is required to make an individual evaluation on 
specific points of each subsection and a general overall evaluation of 
the whole subsection. The entire staff, meeting together, then evaluates 
both the specific Items and each subsection as a whole. A departmental 
profile Is constructed In graphic f^rm as a summary of evaluations made 
of all twenty-seven subsections. 
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